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Abstract 

A personal computer program was developed 
which provides aeronautics and operations engineers at 
Lewis Research Center with a uniform method to 
quickly provide values for the uncertainty in test 
measurements and research results. The software 
package used for performing the calculations is Mathcad 
4.0, a Windows version of a program which provides an 
interactive user interface for entering values directly into 
equations with immediate display of results. The error 
contribution from each component of the system is 
identified individually in terms of the parameter 
measured. The final result is given in common units, SI 
units, and percent of full scale range. The program also 
lists the specifications for all instrumentation and 
calibration equipment used for the analysis. It provides 
a presentation-quality printed output which can be used 
directly for reports and documents. 

Nomenclature 

B'n: Bias component of error 

B: Bias limit estimate 

j: Number of measurement variables 

N: Number of tests (measurement sets) averaged 

to obtain a result 


S'n: Precision component of error 

S: Precision limit of error 

U: Uncertainty estimate 

0: Sensitivity coefficient (partial derivative of 

result with respect to a variable) 

a: Population standard deviation 

Subscripts: 

i: Mathcad range variable 

RSS: Root-sum-square 

x: Measured variable 

y: Measured variable 

(other terms are defined in the comment column 
for the program examples included) 


Introduction 

In order for valid conclusions to be drawn from the 
results of research experiments, it is vital that an 
uncertainty analysis be performed to determine the 
interval about the result in which the true value is 
thought to lie with a certain degree of confidence. 
However, the estimated errors reported for similar 
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research tests by different experimenters may differ 
substantially because of the methodology, assumptions, 
or data base used. Different procedures may be used 
because of the proliferation of standards and guidelines 
which have been published by technical organizations 
such ANSI/ASME 1 , ISO 2 , AGARD 3 , NIST 4 and NASA 5 
in recent years. Although there are efforts occurring at 
present to harmonize the principles of the ASME model 
(Performance Test Code 19.1) and the ISO model 
(Guide to the Expression of Uncertainty in 
Measurement) into a new U. S. National Standard on 
Measurement Uncertainty, any methodology described 
by one of the present standards is currently accepted. 

Another cause of differing results is due to the 
instrumentation specification data and assumptions used 
by the experimenter. Manufacturer's performance 
specifications for data system equipment require proper 
interpretation or knowledge of information, such as the 
manufacturer's testing process, which is not usually 
available in the written specification. Often, the time 
span (i.e., 8 hours, one month, one year) that is covered 
for each stated error source is not indicated, as well as 
the confidence limits or standard deviations (i.e., 1, 2, 
or 3 cr) within which the stated error is contained. 
When a specification for amplifier noise is provided, it 
is only valid when it is adjusted for the particular gain 
and bandwidth used in the application. 

In many instances, the experimenter may only 
consider the intrinsic error specifications given by the 
manufacturer, such as gain accuracy, offset, 
nonlinearity, hysteresis, repeatability, and noise, and 
neglect to include application-related performance 
specifications such as temperature coefficients, reference 
pressure changes, common mode rejection, source 
current and crosstalk. 

Another factor to be considered is the 
uncertainty due to the equipment and methods used by 
the calibration laboratory. Laboratory calibrations are 
typically performed to reduce the total measurement 
uncertainty by providing traceability to national 
standards. It should be recognized that when only a 
single calibration is performed, there is no data scatter 
in the calibration curve provided, and all calibration 


process random errors (such as repeatability and noise) 
are permanently fossilized into the systematic (bias) 
error. Often, only the uncertainty of the reference 
standard is accounted for and other sources of error, 
such as the uncertainties in the transducer readout 
system used in the calibration facility, are ignored. 

This paper describes a PC program that was 
developed in order to provide aeronautics and operations 
engineers at Lewis Research Center with a uniform 
methodology which can quickly provide quantitative 
values for estimating uncertainty in measurements. The 
software package chosen was Mathcad 4.0", a Windows 
version of a program which provides an interactive 
interface which allows the user to enter values directly 
into equations with immediate display of results. Read- 
only files were written for the standard types of 
instrumentation and data acquisition systems used in the 
aero test facilities and for the data reduction equations 
most commonly used. 

Program Assumptions 

The method to calculate uncertainty for these files is 
consistent with the concepts developed and evolving in 
the international standards with enhancements most 
commonly accepted, and is in compliance with the 
recent NASA Metrology - Calibration & Measurement 
Process Guidelines 5 . For each measurement process, all 
likely elemental sources of error are identified and 
classified as either Systematic (B'n) or Precision (S'n) 
depending on their effect on the data. Systematic errors 
bias all data samples and cannot be observed in the 
data; they must be estimated using either good 
engineering judgement and experience, manufacturer's 
specifications, or other information. The Systematic or 
Bias Limit (B) is the experimenter's 95% confidence 
estimate of the band within which the mean value would 
fall if the experiment were repeated many times with 
the same equipment and test conditions. Precision or 
random errors are those that cause scatter in the data 
and are often estimated via statistical analysis of repeat 
measurements over an appropriate time interval. For the 
measurement processes evaluated in these files the 
distribution of these errors is assumed to be 
approximated by a normal (Gaussian) and symmetrical 
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distribution around the mean. A sufficient number of 
data samples (>10) are averaged by the data acquisition 
to approximate the interval which should include 95% 
of individual samples by multiplying the standard 
deviation of the total data set (S) by a coverage factor 
of 2. 

To obtain the Total Uncertainty evaluated by 
the Root-Sum-Square method (U RSS ), the estimates of B 
and S are combined with the equation, 

U„ = i(B) 2 + (2SlM 2 

The term /N is used to account for the 
reduction of random error when multiple experiment 
repetitions are averaged into a result. The 
manufacturer's specifications for systematic limits used 
in these files are assumed to be at a 3 cr (~ 99%) 
confidence level (unless other data is available) which 
provides a theoretical confidence level for U RSS of about 
97.5%. In order to account for the difficulty in 
predicting environmental conditions, however, a more 
conservative value of 2 a (95%) is quoted for the 
overall uncertainty. This provides an appropriate level 
of confidence in the uncertainty estimates for the types 
of tests performed in aero facilities. 

For the files used to evaluate the uncertainty of 
results in data reduction equations, an engineering 
analysis was used to determine the systematic errors 
which are correlated for the type of measurement 
system used. It was assumed that all precision errors 
are uncorrelated, although there are some special cases 
where this is not true, as discussed by Hudson, et al 6 . 
The value for the term / N requires an assessment of the 
number of data sets that are averaged to obtain a result. 
Since this requires a very careful examination of the 
total measurement and data reduction process 7 , a 
conservative value of one (1) is usually chosen unless 
the experimenter is certain that all data values which are 
averaged together are truly random samples from the 
total data set with all precision error sources having had 
an opportunity to influence the result. 

Measurement System Files 


The group of data files used with this Mathcad 
program are installed on a shared drive (with read-only 
protection) on the Local Area Network Server (DIMS) 
used by the Aeropropulsion Facilities and Experiments 
Division (AFED). An index is provided on a server file 
to identify the data files available. A listing and detailed 
description of the files is provided in AFED Preliminary 
Information Reports 9,10 . The selected data files are 
downloaded to the hard drive or removable disk on the 
engineer's office PC for computation and printout. 
Measurement instrumentation, data acquisition system 
and aerodynamic equation files can be linked together 
in order to propagate the elemental errors in the 
measurements through the data reduction equation, 
thereby generating the bias and precision errors and the 
uncertainty estimate for the experimental result. 

The data files that were written for the measurement 
and data acquisition systems were designed specifically 
for the systems and practices in current use at NASA 
Lewis and should not be used by other organizations 
without careful examination of the factors and values 
given. Also, when actual data is available from a test or 
when a system is being used in a unique manner, the 
best data available should be used. 

Each of the files, when retrieved into the Mathcad 
program, provides a page for entry of the numeric 
values for the application, one or more pages of 
calculations of the elemental bias and precision errors 
and total uncertainty estimate, and a final page listing 
the standard assumptions for the instrument 
specifications and error source values. Data files are 
currently available or are planned for the following 
instrumentation: 

- Electronically scanned pressure systems 

PSI, Inc Model 780B & Model 8400; 
rackmount or miniature modules 

- Escort D/D+ (Lewis's facility DAQ systems) 

Neff Model 400, 100/200, 600, and 
470 mux/amp system 

- Thermocouples 

Type K, T, J, E, and P13 

- High output (capacitive type) pressure transducers 
Setra Model 204, 204D, 239, 270, and 370 
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- Strain gage pressure transducers 

Lewis Instrument Pool standard models 

- Miniature semiconductor strain gage transducers 

- Standard load cells 

- Liquid turbine type flowmeters 

Lewis Instrument Pool standard models 

A typical measurement file is shown in 
Example A. On the first page, the numeric values used 
in the test are entered in the placeholders for both the 
data acquisition system (Escort D/Neff 400) and the 
thermocouple system, since this is the arrangement 
commonly used. The calculations on the second page 
are used to convert the test temperature (TJF) and the 
reference temperature (T REF) to a millivolt output 
using the conversion polynomial from NIST Monograph 
175. On the third page, this millivolt value is used to 
determine a sensitivity factor (SEN) used for 
calculations of the elemental bias (B'n) and precision 
error (S'n) estimates in temperature (°F) and the 
Uncertainty limit (U RSS ) in temperature (°F & °C) and % 
of test temperature. The term /N is assumed to be 1 
for thermocouple files. The fourth page lists the 
specifications for this measurement system. 

Data Reduction Equation Files 

In most experimental programs, the measured 
values of different variables are combined using a 
number of data reduction equations to obtain test 
conditions and performance results. The methods used 
to propagate the errors in the measurements through 
these equations to obtain an estimate of the uncertainly 
limit in the results are given in detail in the 
references 1 ,5,6 . For each case, not only must a sensitivity 
factor for the equation be calculated for the systematic 
and precision limit of each variable, but an engineering 
analysis should also be made of the elemental 
systematic or precision uncertainties that are correlated, 
that is, they arise from the same source. For a case 
where an experimental result, r, is a function of two 
measured variables, x and y, and the systematic 
uncertainties B' x and B' y are the systematic uncertainties 
in x and y that arise from the same source, 


B r = [(® X B X ) 2 + (® y B y ) 2 + 2© x @ y B' x B' y ] /s 
where © x = dr/dx and © y = dr/dy 

Usually, the elemental error for the precision 
uncertainties in x and y are uncorrelated. Thus, the 
sample standard deviation in the result is, 

S r = [(0 X S X ) 2 + (© y S y )T 

With a coverage factor of 2 and N r sets of 
measurements obtained over an appropriate time period, 
the uncertainty estimate of the result is, 


U r = ]j(B r ) 2 + (2SjyW r ) 2 

In Example B, a Mach number file is combined with 
an ESP system file to obtain values of uncertainty in the 
Mach number for a series of test conditions. In this 
case, the bias errors in BT, B'2, B'3, which are 
associated with the common Digiquartz calibration 
transducer, and B'4, which is a common module 
atmospheric reference. The partial derivatives for the 
Mach number equation were obtained with Mathcad's 
Symbolic Operator by setting the cursor on the variable 
to be evaluated and choosing the Differentiate on 
Variable command from the Symbolic menu. This must 
be performed before the range variable (i) is added to 
the function. 

Data files are currently available or are planned for 
a variety of data reduction equations including Mach 
number, dynamic pressure, flow angularity (a & (3), 
and mass flow (venturi, orifice plate). 

Summary 

This program has provided the experimenter with a 
user friendly method to estimate measurement errors for 
any particular set of test conditions. Since it identifies 
the error contribution from each component of the 
system, it provides insight into potential improvement 
areas where productive actions may be taken to reduce 
uncertainties. Thus, many "what-if changes in the 
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instrumentation system design may be tried, and the 
results instantly determined. It assures that a uniform 
data base and methodology is used for all test facilities 
and it serves to document the specifications for all 
instrumentation and calibration equipment used in the 
analysis for future reference. It also provides a report- 
quality printed output. 
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Example A 


Measurement Uncertainty Program 


C) THERMOCOUPLES (including ESCORT/Neff 400 DAQ Syst) 
1.) TvpeK ('Chromel-AlumeD (File tckooi.mcd') 

F :=R C :=K |iV:=mV10' 3 


T_F:=i °F 
missing operand 


ENTER: T/C temperature to be evaluated (°F) 
(0to2300F) 


T_C :=--([LS- 32) 


Elc = 


°C T/C temperature (°C) 


TJREF = ^ °F ENTER: 150 for 1 50 °F Reference oven or 75 for Isothermal Block 

missing operand 


MV :=ymV 
missing operand | 


ENTER: ESCORT D/D+ Millivolt Range (+/- 5, 10, 20, 40, 80) 



ENTER: Temperature excursion of ESCORT System from 
calibrated temp (°F) (typical value, 5 °F) 


ENTER: Common Mode Voltage in Test Cell (Volts) 
(typical value, 5-10 volts) 


CSTK :=i V ENTER: Voltage difference between consecutively scanned 

~ 1 channels (Volts) (if less than 100 mV, enter O) 

missing operand] 


^ 10240-mV 

" m 



Neff Amplifier Gain 
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Page C.1.2 


TYPE K T/C Conversion Polynominal (Temp to mV) 


0 C to 1 372 C 
1.185976- 10 2 
aj 1.183432 10“ 4 

c Q :=- 1.7600413686- 10 1 
Cj := 3.8921204975- 10 1 
c 2 := 1.8558770032- 10* 2 

c 3 9.9457592874- 10’ 5 


c. := 3.1840945719- 10' 7 * 

4 

c 5 :=- 5.6072844889- 10" 10 

c 6 := 5.6075059059- 10" 13 

c ? : = - 3.2020720003 • 10 1 6 

c 8 := 9.7151147152- 10" 20 

c 9 :=- 1.2104721275- 10" 23 
n :=9 


E 1 := 


1 n 

\i = 0 


+ V 


a r (ff~g - 126.9686) 


nV 


E 1= -jiV 


-270 C to O C 
c o :=0 


Cj : — 3-9450128025* 10 


c 2 := 13622373598- 10 


-2 


c 3 :=- 3.2858906784- 10 


.-4 


c. :=- 4.9904828777- 10 

4 


-6 


c 5 :=- 6.7509059173- 10 


-8 


c fi :=- 5.7410327428- 10 


-10 


c ? :=- 3.1088872894- 10 


.-12 


Cg :=- 1.0451609365-10 


c 9 :=- 1.9889266878-10' 


,-14 


17 


c, 0 :=- 1.6322697486-10 
n :=10 


-20 


E_2:= Y, '‘HE2-& 
i = 0 


= *fiV 


E REF if dT REF <150 > 0.95-mV > 166-mV) {E REF = ‘fiV 

EJ3:=if(fFT<oJQJF7) O- *^ V 


E o := 


-E REF 


*mV Output at Evai Temp 
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PaoeC.1,3 


Error Source Evaluation (NOTE: all errors are +/-) 


-[T REF) F 


SEN := 

B'l := if(ffn<S30 > 2-F > 0.0037S-[fFi-F) 

B'2 := if (fr~KEF <lSQ, 1.096- F, 0.746- F) 

B’3 :=(0.05-% 

S'l := (0.0017-% 

B'4 := (o.02'%- 


2-2 


13 


B'5 :=0.010 mV-|EN 


S'2 := 1 0.005- mV + 1 ' 2S J?- + 


B’6 := fomV* 


10 


B'8 := 


/ ! _\_ 

i-pv - [sen 


B7 := ||G»mV*iS££S j-lSENj 

10 6 / 


\2 


13 


S'3 := 


LN 


).0085 2 + /0 ' 75 


•mV 


[SEN 


SEN = 


mV 


B’l = -F 


tB'2l = *F 


B3j= *F 
T = *F 


[B'4j = *F 


tB'5l= *F 


+ 


0.06-mV- 


KEN 


tB'6i = *F 


.71 = -F 


B'S= *F 


S'3 = -F 


Sensitivity (°F/millivolt at eval temp) 

Type K Thermocouple error (°F) 

Reference Junction Box Error (°F) 

Neff Gain Accuracy 
Neff Thermal Gain Accuracy 

Neff Non-Linearity 

Chan-Chan Offset 
|sj2 = *F Zero Stability 

Common Mode Voltage 
(NOTE: log” 1 (1 20/20)^1 0 6 > 

Static Crosstalk 
Digitizing Error 


Noise (+/- 3 sigma) 


B :=> 


d 3) 2 + @) 2 + (@> 2 + (|3) 2 + (@) 2 + @) 2 4- ®) 2 +• ( HI ) 2 



•F 



Temperature Measurement Uncertainty 


u 


RSS 


+ (2 I) 





+/- Uncertainty (°F) 

4-/- Uncertainty (°C) 

+/- Uncertainty (% of Eval Temp) 
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Paqe ., Q : i . .4 Error Source Description 

(+/- %FS, except where noted) 

Type K T/C Conversion Polynomial - NIST Monograph 175 


B'l - ISA Type K Thermocouple Wire (Special) 

32F to 530 F +/-2.0°F 
530F to 1400F +/- 3/8% of Rdg 


B'2 M50 R - Thermocouple Reference Oven (U-48/U49) 


BT0 :=0.25 

Oven Temp Error (°F) 

BT1 : = 0.02 

PRT Error (<>F) 

BT2 :=0.03 

PRT Readout (Instrutab) Error (°F) 

B'l 3 :=0.7 

Thermocouple Output Error (°F) 

B'l 4 := 0.0128 

T/C Readout (Keithly 182) Error (°F) 

B'l 5 :=0.05 

Ice Point Error (°F) 

B lso :=J(B'10) 2 + 

(B'11) 2 + CB'12) 2 + (B'13) 2 + (B'14) 2 +(B'15) 2 B )jo = 0.746 


B'2 f75 R - Thermocouple Reference Isothermal Block 


B'20 := 1.0 

RTD Accuracy (°F) (Mfgr’s spec is 0.5%, waver to 
1% granted 1/6/87. 

B’21 := 0.02 

PRT Error (°F) 

B’22 =0.03 

PRT Readout (Instrulab) Error (°F) 

B'23 :=0.4 

End to End Block Error (Specification) (oF) 

B'24 := 0.2 

T/CStability Error (Specification) (°F) 

B 75 :=J(B'20) 2 + (B'21) 2 + (B'22) 2 + (B'23) : 

1 + (B'24) 2 B 75 = 1.096 

Neff 400 SDecifications 

B'3 - +/- (0.05% FS) 

Gain Accuracy 

S'l- +/- (0.001 7%FS/°F) 

Thermal Gain Accuracy 

B'4 - +/- (0.02% FS + 1/2 LSB) 

Non-Linearity 

B'5 - +/ -0.0 10 mV 

Chan-Chan Offset 

S' 2 - +/-(0.005 mV RTI + 1 .25 mV RTO) + (0.00028 mV/°F RTI + 0.06 mV/°F RTO) Zero Stability 

B'6 - 80 dB plus gain (in dB) to 120 dB 

Common Mode Rejection 

B'7 - 120 dB 

Static Crosstalk 

B8-1/2LSB 

Digitizing Error 


S' 3 - [(0.0085 mV x Gain) 2 + (0.75 mV) 2 3 iy2 


Noise 
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Example B 


Measurement Uncertainty Program 


A) ESP SYSTEM 

1.) 780B System using Rackmount Modules (File espoo i.mcdi 


D := 15-psi 


. lbf 
P ” := 7i 

in 


psf:=P^ 

144 


l^a^newton.lOoo 

m 2 


ENTER: Digiquartz Range (6, 15, 23, 30, 45, 65, 100, 300, 500) 


t 1 :=2 


ENTER: DQ temp excursion from calibrated temp ( °F ) 
(typical value for temp controlled box, 2) 


M :=5 psi 


ENTER: Module Range (1, 2.5, 5, 10, 15, 30, 45, 100, 250, 500) 


M t :=1 


SF := 1000 — 
psi 


ENTER: Module sensor temp coeff factor (1 if S/N 1 to B02037 (9/93), 

2 if S/N B02038 up) 

ENTER: Scale Factor for module group (see Table 1) 


B'5 :=0 psi 


t 2 =0 


ENTER: Module ref press change allowed between cals (psO 
(typical value for atmospheric reference, 0.01) 

ENTER: Module temp excursion allowed between cals ( °F ) 
(typical value, 3) 


N :=20 


ENTER: Number of Data Sets that are averaged to obtain result 
(if a single data set is used, enter 1) 


k := if(D<15psi,0.01 1 ,0.012) k = 0.012 


Cal lab DQ calib error coefficient 


Z_1 := if(M<5psi, 0.05,0.02) Z_1 = 0.02 Z_2 := if(M<2.5-psi,0.008,0.004) Z_2 = 0.004 


Z_3 =if(M_t<2,Z_l ,Z_2) Z_3 = 0.02 

S_1 :=if(M<2.5-psi, 0.05, 0.02) S_1 =0.02 


Module thermal zero shift coeff 


S_2 := 0.003 

S_3 : = if(M_t<2 , S_1 , S_2) S_3 =0.02 


Module thermal span shift coeff 
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Page A.1.2 


Error Source Evaluation (NOTE: all errors are +/-) 

780B System using Rackmount Modules 


B'l :=k%*D 

B'l =0.0018 *psi 

Cal Lab DQ calibration error 

B'2 :=0.001*t_l %*D 

B'2 =0.0003 *psi 

DQ temp error 

B'3 := 0.005* %*D 

B'3 = 0.00075 *psi 

Time base error 

B'4 := 0.005* %D 

B’4 = 0.00075 *psi 

Curve fit error (Digiquartz) 

S’l := 0.005 %*D 

S'l = 0.00075 *psi 

Repeatibility (Digiquartz) 

S'2 := 0.005 %*D 

S'2 = 0.00075 *psi 

Hysteresis (Digiquartz) 

S'3 := 0.0005 %-D 

S'3 = 0.00008 *psi 

Counter resolution (Digiquartz) 

S’4 := 0.010 %*M 

S’4 = 0.0005 *psi 

ESP repeatability 

S'5 := 0.005 %*M 

S'5 = 0.00025 *psi 

ESP hysteresis 

B'5 =0*psi 


ESP reference pressure change 

B'6 :=Z_3*%*t_2*M 

B’6 = 0 *psd 

ESP thermal zero shift 

B7 :=S_3-%-t_2-M 

B'7 =0*psi 

ESP thermal span shift 

B'8 := 0.010 %*M 

B'8 = 0.0005 *psi 

Non-linearity curve fit error 

S'6 :=0.012*%*M 

S'6 = 0.0006 *psi 

ESP A/D converter resolution 

S'7 :=— 

S7 =0.001 *psi 

ESP computer ouput resolution 

SF 



B :='J(B , 1) 2 + (B'2) 2 + (B'3) 2 

+ (B'4) 2 + (B'5) 2 4- (B'6) 2 -h (B7) 2 -t- (B'8) 2 

B= 0.00217 *psi 



S:=V(S'l) 2 -h(S’2) 2 +(S , 3) 2 + 

(S’4) 2 + (S'5) 2 + (S’6) 2 

+ (S7) 2 


S =0.00167 *psi 

Pressure uncertainty 


u 


RSS : 


B 2 + M 


U/n/ 


u 




U RSS 

M 


U = 0.00229 *psi 

U RSS s=a33044 *P sf 
U RSS =0.01582 *Pa 

Uo /o =0.04589*% 


+/- Uncertainty (psi) 

+/- Uncertainty (psf) 

+/- Uncertainty (kPa) 

+/- Uncertainty (% of Module Range) 
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Page M.1.1 

Mach Number Uncertainty (File Machooi.Mcm 

BPt :=B BPs:=B B =0.00217 *psi Systematic uncert in total and static pressures 

c 

SPt := 2 — SPt = 0.00075 *psi Precision uncert. in total pressure 

SPs : = 2 — SPs - 0.00075 *psi Precision uncert. in static pressure 

BPc :=*]& l 2 + B'2 2 +• B'3 2 + B'5 2 BPc = 0.00197 *psi Correlated bias errors 

BPtc := BPc BPtc = 0.00 1 97 *psi Correlated bias errors in total p 

BPsc : = BPc BPsc = 0.001 97 *psi Correlated bias errors in static p 


Uncertainty in Results 

Nr := 4 ENTER: Number of measurement sets averaged 

n := 12 i : = 1 .. n ENTER: Number of test conditions to be evaluated 


Pt:= Psl := ENTER: Values for total and static pressures at each 


14.487 

14.493 

14.503 

14.420 

14.535 

14.554 

14.457 

14.575 

14.598 

14.530 

14.657 

14.680 


14.462 

14.456 

14.438 

14.317 

14.391 

14.354 

14.232 

14.315 

14.275 

14.129 

14.168 

14.151 


test condition 


Mo. 

i 



6Ps. := 


7- 


-5 


(Pt)W-5.(Ps.)^ 




rN 


Calculated Mach number (Mo) at 
each test condition 

Mo. 

i 

0.04968 
0.06044 
0.08013 
0.10125 
0.11935 
0.14074 
0.14986 
0.16056 
0.17907 
0.20035 
0.2207 
0.22958 


Mo sensitivity coeff.for 
static P 


eps. 

i 


-0.99468 

-0.81811 

-0.61818 

-0.49377 

-0.41706 

-0.35499 

-0.3364 

-0.31237 

-0.28122 

-0.25436 

-0.23066 

-0.22218 
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Page M.1.2 


5 


Mo sensitivity coeff.for 
total P 


UMoB. : 

i 


UMoS. : 

i 


UMo 



0Pt. 

i 


0.99297 

0.81602 

0.61541 

0.49024 

0.41293 

0.35011 

0.33117 

0.3068 

0.275 

0.24734 

0.22296 

0.21418 


:J[ (ePt-BPt) 2 + (9 Ps.BPs) 2 + 2- (S’!;)- (8P&)(BPtc)(BPsc)]“ 


Combined systematic 
component of Mo Uncert 



(UMoB.) 2 + 


2-UMoS. 

t 

Jnt 


2 


Mo. UMo. 

i i 


0.04968 


1 

0.00165 

0.06044 


0.00135 

0.08013 


0.00102 

0.10125 


0.00082 

0.11935 


0.00069 

0.14074 


0.00058 

0.14986 


0.00055 

0.16056 


0.00051 

0.17907 


0.00046 

0.20035 


0.00042 

0.2207 


0.00038 

0.22958 


0.00036 


Combined precision component 
of Mo uncertainty 

UMoS. 


i 


0.00105 

0.00087 

0.00065 

0.00052 

0.00044 

0.00037 

0.00035 

0.00033 

0.00029 

0.00027 

0.00024 

0.00023 


UMoB. 


i 


0.00127 

0.00104 

0.00079 

0.00063 

0.00053 

0.00045 

0.00043 

0.00039 

0.00035 

0.00032 

0.00029 

0.00028 


Combined uncertainty in Mach number (RSS) 
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paoe A.i.3 Error Source Description 

(+/- %FS, except where noted) 

780B System using Rackmount Modules 

Digiquartz - Cortez 111 Calibration 

(Possible temperature variation during calibration: +/-0.5F) 



+/-6PSID 

15PSIA & Higher 

Repeatability 

0.0030 

0.0015 

Curve Fit Error 

0.0015 

0.0030 

Temp Error 

0.0015 

0.0015 

Ref Pressure Error 

0 

0.0030 

Ruska Deadweight (0.01% Rdg) 

0.0100 

0.0100 

Temp Uncert Error 

0.0009 

0.0009 

Readout for Paroscientific 

0.0023 

0.0023 

B' 1 - Calib Uncertainty (RSS) 

0.011% 

0.012% 


Digiquartz Specifications 


B'2 - 

0.001% /°F 

Temp error (per Cortez temp evaluation test) 

B'3 - 

0.005% 

Time base error (Estimate by PSI) 


B'4 - 

0.005% 

Curve fit error (estimate by PSI) 


S'l - 

0.005% 

Repeatibility (Paroscientific specs) 


S' 2 - 

0.005% 

Hysteresis (Paroscientific specs) 


S' 3 - 

0.0005% 

Counter Resolution (PSI specs) 


ESP Rackmount Module (S1600/S3200) Specifications 


S' 4 - 

0.010% 

Repeatability (estimate by PSI) 


S' 5 - 

0.005% 

Hysteresis (estimate by PSI) 


B 6 - 

0.02%FS/°F 

Thermal zero shift ( 5 - 500 psid ) (S/N 1 to BO2037) 


0.05%FS/°F 

" " " ( 10" WC -2.5 psid) " 

M M 


0.004%FS/oF 

" " " (2.5 -500 psid) (S/N BO2038 & up) 


0.008%FS/oF 

" " " (10"WC - 2.5 psid) " 

M M 

B'7 - 

0.02%FS/°F 

Thermal sensitivity shift ( 2.5 - 500 psid ) 

(S/N 1 to BO2037) 


0.05%FS/°F 

" * " " (10" WC-lpsid) 

H M 


0.003%FS/oF 

" " " " (AH Ranges) 

(S/N BO2038 & up) 

780B DACU/PC Signal Processing & Data Reduction Specifications 

B'8 - 

0.010% 

Curve fit error (2 n£ * order) 


S' 6 - 

0.012% 

A/D converter resolution (0 to FS) 


S'7 - 

0.00025 psi 

Output resolution - ESP computer to ESCORT (Scale Factor 4000) 


0.0005 psi 

n n it w n 

(Scale Factor 2000) 


0.001 psi 

MM MU M 

(Scale Factor 1000) 


0.002 psi 

MM MM M 

(Scale Factor 500) 


0.005 psi 

MM MM M 

(Scale Factor 200) 


0.01 psi 

MM MM M 

(Scale Factor 100) 


0.02 psi 

MM If M M 

(Scale Factor 50) 
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